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ABSTRACT 
This ‘study replicates part of a 1964 study designed 

to examine variations in the attainment of cognitive objectives in 
“high school chemistry. In 1964 a traditional curriculum was used, but 
by 1972 when the data for this study were collected, a mod23rn course 
based on CHEM study was being used. Scores on a 60-item end-of-course 
test given to different samples of stuijents before and after 
establishment ‘of the new course are compared. Students also wrote a 
scholastic aptitude test, the Inventory of Choices, and a summary of 

their educational plans. An adaptation of two-way analysis of 
variance was used to analyze the residual chemistry scores. Amor] the 
findings were::(1) the aptitude scores of the 1972 group were 
substantially lower than those of the 1964 group; (2) substantial 
declines in achievement were observed across all four levels of the 
Bloom's Taxonomy; and (3) a substantial portion of the students in 
the 1972 sample had a pattern of achievement in which their 
»performance in categories 2.00, 3.00, or 4.00 appeared to be tiei to 
the ability to recall factual knowledge (category 1.00). (MK) 
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This study replicates part of a 1964 Ontariod study (Even, 1968) 


‘designed to examine variations in the attainment of cognitive objectives 
in Grade 12 Chemistry. In 1964 most Ontario students were pursuing a 
"traditional" course of! istudy. During the latter half of the sixties 


'". the traditional course gave way to a "modern" type of course heavily in- 


fluenced by CHEM Study. Considerable adaptation of courses of. study to 

meet local needs was encouraged,- and considerable wodernization of 

chemical“tontent was introduced. Perhaps the most noteworthy change in 

the study of chemistry at the ne school level was the declared 

shift in emphasis from acquisition of factual knowledge to the development 

of higher cognitive skills. By 1972, the year in which data for this study 
were collected, course innovations and experimental ° tryouts had consolidated. 

As a result of the changes in curriculum it is reasonable to expect 

that patterns of achievement would change in the directions of greater 

. heterogeneity and increased attainment of higher cognitive skills. Therefore 
it was ~considered appropriate to compare patterns of achievement before and 
after establishment of. the modern type of course. Patterns of achievement 
were sought in profiles of residual achievement scores in the selected 
processes of’Knowledge, Comprehension, Application and Analysis describedsin 
the Taxonomy of Educational Objectives: Cognitive Domain (Bloom et al, 1956). 
Patterns of achievement were compared in groups differing in aptitude, attitude 
and educational plans. 

In the 1964 sample a 60 item end-of-course test, developed over a three- 
year period, was administered to over two thousand students in 30 Ontario 
high schools that had been selected at random. . Since there had been 
considerable changes in course content, the test could not be used in its 
entirety in 1972. A panel composed of experienced teachers and other science 
apatatate identified 35 of the 60 items as still having high content validity 
est the 1972 administration, Add ttonel items were’ constructed, critically 
revised by the patel. and then adged to the 35 items to make a new bass 
‘The new test and the old were equated by the Rasch method (Wright 1967, 

. Wright & Panchapakesan 1969, Wright & Svnwlus, 1975) so that any given score 
on the 1972 test could be expressed in terms of an equivalent 1964 score. 


Equating of, the aptitude measures jalso was: necessary since the aptitude test 
cused in 1964 had been dtnconctowel , 
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In i) studies students wrote a scholastic aptitude test and the 

Inventory of Choices, a wandee of atti udinal orientation (Edwards and- 

Wilson 1959a, 1959b) (Figs. 1&2). Almdst three thousand etudelts from 
chools participated in the 1972 sthdy. \ 


Haggard's method of profile analysis, en adaptation of twotway 


analysis of variance, was used to anglyze the residual chemistry gcores; 


residual scores.were defined as raw bvievenent scores in each Takonomy 
category minus the corresponding scdre predicted from. ceitbal and| - 

mat atical aptitude scores by appropriate regression equations 
Comporfents of the patterns also were ekamined for changes. Thes 
components consisted of aptitude and achievement scores, attitudinal 
orientation scores and sundry descriptive measures. Achievement patterns 

' (Figures 3-6) were analyzed in terms of stabilizedyscores (S-scores) 
obtadped by dividing each subtest score by its standard error of measurement. 


(Haggard, 1958, Chap.’ VII; Even, 1968, pp.98-100). . 4 
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The principal findings were as follows: 

Ls During the period from 1964 to 1972 substantial declines in aptitude 
scores were observed (Table 1); these declines were greater im\the 
general population than in the chemistry sample, and were greater in 


verbal aptitude than in mathematical aptitude. While the chemistry 


sample exhibfted only a small decline in mathematical aptitude, the : ‘ % 
verbal decline was substantial.- ~ * -¥ 
"De Substantial declines in equivalent achievement scbres were observed 


bn tbe total score and in every subtest (Table 2). Taxononly 

Category 1.00 (Knowledge) showed the most decline and Category 2.00' 

(Comprehension) showed the least. While some of the decline could be 

attributed to the drop 7 aptitude scores, declines’ persisted after 

the effect of lowered aptitude scores was taken into account. 
3. Achievement in the Knowledge category was more variable in 1972 than 
in 1964. In the 1972 sample there were also more excessive deviations, 
fram the mean ene in the case of a normal distribution, which the 1964 Know Ledge 
acores closely approximate in kurtosis. The trend observed here is one of 
polarization, with> 1972 students -becoming either more prone to recall factual 
informationsa# a cognitive strategy.or less prone to recall facts than the 


1964 group. 
t 


In- the interval under study changes wete observed in attitudinal 
orientation (Table 3). _From 1964 to 1972 there-were moderate to 
substantial shifts away’ from tHe Theoretic and Prudent orientations 
and toward the Immediate orientation, indicating, in‘the 1972 sample, 
less‘preference for activities of a deliberative nature and more 
preference for activities of a socially influenced and non-deliberative 
nature. The gypical plans: in c mistry in 1972 contained 
proportionately fewer students terested in the ‘kinds of mental ’ 
eactfvities that scientists pursue, and proportionately more acndante 
who are vitally interested in and influenced by what peers do or say. 

A substantial por fon of the sfludents (about 30%) in the 1972 sample . 
had a pattern of achkevement in which their performance in categories 

“2.00, 3.00 or 4.00 appeared to be tied to the ability to recall factual 
knowledge (category 1.00) (Figs. 3&4). Such a relationship was not 

observed in the 1964 sample where recalling specific information had no 


diet mia t to per formance in the higher Taxonomy categories studied. 


_ Normal achievers (1. e. those not classed as overachievers or under- 


, achievers) in the 1972 sample appear to have congruent patterns of 


corresponding group was chara 


achievement in categories 2.004) 3.00 and 4.00 whereas in 1964 the 
Sie by lack of ‘uniformity in patterns 


‘of achievement. : 


In the 1964 sample distinctive patterns were observed amongst overachievers 


and underachievers (Fig. 4) and amongst highly Theoretic and highly 
Immediate non-normais (Fig. 6). In the 1972 samples (Figs. 3&5) these 
distinctive patterns disappear. , 

The overall decline for highly Theoretic non-normals is greater than that 
for their highly Immediate counterparts. (Figs. 5&6). se 

In the 1964 overachiever pattern (Fig. 4) and in the 1964 highly Theoretic 
sorm-nerwal achiever pattern (Fig. 6) a significant: peak occurred at 
Category -3.00. In the 1972, patterns this peak at Category 3.00 disappears, 
to be replaced by a peak at Category 2,00 in all groups. Thus in the 1972 


groups the most proficient skill occurs lower in the cognitive hierarchy 


than in the 1964 sample. 
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In addition to the general decline in achievement, the patterns of 
achievement show a move toward uniformity, both in the lo$s of @istinctive ° 
patterns and in the appearance of factual recall as an integral part of 
the pattern of a large segment of the student population. . There also appears 
to be a downshift in the cognitive achievement pattern so that the most 
proficient skill fs lower in cognitive lave than it was venice Sy. 

The effects observed are gpposite to what the program ‘was intended to 
accomplish. The findings thus ate cause for concern, particularly in view 
of (1) the trend in modern science ¢ourses to minimize the dependence on - . 

_ ‘factuab recall and .(2) the Increasing, ‘awareness of the need to encourage and 
‘provide for individufl differences. Morégver, should the observed trends in 


achievement and student characteristics con§Anue, the present: program will 


ef become fncreasingly inappropriate for its students. 
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TABLE 1 | 


| 
COMPARISON OF SATO* SCORES FOR PRESENT AND : + 
PREVIOUS SAMPLES i 
RAW SCORES . | 
Test Group N Mean SD 
SATO : \ | 
Total Verbal 1974 Ontario Equating \ 
Group’ ’ 379 23.57 8.314 
+1972 Chemistry Sample 2,431 23.82 8.20. 
. 1964 Chemtstry Sample 2,248 26.18 6,33. | 
1964 Ontario Grade « : 
“~s 12 Population 44,029 26.50 8.29 
(General Course) 
SATO . ; 
Mathematics - 1974 On€ario Equating | 
‘Group 362 ° 15.54 5.76 
+1972 Chemistry Sample . 2,431 16.73 5.88 ‘ 
1964 Chemistry Sample 2,248 17.05 5.69 
. 1964-Ontario Grade 
12 Population : 44,016 17.18 5.69 
(General Course) 
* VT 
. Scholastic Aptitude Test (Ontario), 1963-64 Edition. ; 
+SATO.Equivalent Scores, derived from SCAT-II 1A scores equated through 
the Ontario equating group. 
{ 
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, TABLE: 2 


CHANGES IN CHEMISTRY ACHIEVEMENT 
1964 to 1972 


, 1972 Sample 1964 Sample Change, » | Change, ~ 
’ Test = N= /2431 N= 2339 in 1964 | in 1964 
Original 1972 | Equivalent 1964 Raw Score sp, 
Raw Score ‘Raw Score Raw Score Units Units 
— 


No. .of items 


Mean 

SD , 

Tax. Cat. 1.00 , s 

Mo. of items 15 

Meart “6.69 

sD 2.81 

Tax. Cat. 2.00 

No. of items | 1S: 

Mean 6.59 

sD 2.78 

Tax. Cat. 3.09 

No. of items .- 15. 14 

Mean 5.93 | 4.91 6.19 

sD 2.74 I 2.49 2.60 

Tax. Cat. 4.00 = 

No. of items 15 12 12 

Mean 3.97 221 4.00 

SD 2.09 1.62 1.87 
Bact ane. See ETN EE ED ew ceytee e: Centr. 


All changes in means significant at the .001 level 


All changes in SD significant at the #05 level except 
for total score A 
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: TABLE 3 


CHANGES IN ATTITUDINAL ORIENTATION 
1964 to 1972 


eee S ody 4 . ‘ . 


Mean . ; Direct ior of 
. x 
aophe 1922 1964 ehange Change 
Prudent” ’ 2.76 2.60 116s Away from Theoretic 
Theoretic : N = 2182 N = 2016 
« Prudent- 2463: 2.68 1 -.25 ' Toward Immediate 
- Immediate N = 1947 N= 1816 i 
Prudent- 1.80 , 1.99 -.19 Away from Prudent 
Aesthetic N = 2150 N= 1965 : 
- Theoretic 2.16 2.37 =f Away from Theoretic 
Immediate N = 2133 N = 1904 Toward Immediate 
- Theoretic 26S * 2038 -.23 Away from Theoretic 
Aesthetic . N= 2040 N = 1889 
Aesthetic 2.54 2.64 - -.10 Toward Immediate 
Immediate N = 1829 N= 1835 


*all changes significant at the OL level 
No significant changes observed in variance. 
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